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(54) Additional information embedding and detecting method and apparatus 



(57) An apparatus and method for embedding addi- 
tional information embeds plural pieces of additional 
information on a signal as electronic watermark infor- 
mation. In detail, plural pieces of additional information 
to be embedded on a signal are generated, the addi- 
tional information is converted into electronic watermark 
information, the sizes of embedding parts for respective 



electronic watermark information are defined under 
control, and the electronic watermark information is 
embedded on the signal based on the control signal. 
Therefore, the additional information are embedded so 
that additional information having a higher significance 
degree can be more reliably and rapidly detected. 
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Description 

[0001] The present invention relates to an addi- 
tional information embedding method, additional infor- 
mation detecting method, additional information 5 
embedding apparatus and additional information 
detecting apparatus which are utilized to embed plural 
pieces of additional information, for example, on a video 
signal as electronic watermark information, and to 
detect the plural pieces of additional information from 10 
the video signal. 

[0002] Increasingly spreading digital contents such 
as the Internet, compact discs (CD), digital video discs 
(DVD) have given rise to a problem of copyright infringe- 
ment due to unauthorized copies of such digital con-' 15 
tents. To solve this problem, a copy control scheme has 
been contemplated, where additional information for 
copy control (hereinafter referred to as the "copy control 
information") is embedded on digital contents by elec- 
tronic watermark processing to prevent unauthorized 20 
copies. 

[0003] The electronic watermark processing adds 
information as noise, to a portion existing in a video sig- 
nal or an audio signal which is not important from a 
viewpoint of human's perception, i.e.. to a portion which 25 
is not redundant for music or video. Such information 
added to a video signal or an audio signal by the elec- 
tronic watermark processing is hard to remove from the 
video signal or the audio signal. On the other hand, 
even if a video signal or an audio signal has been fil- 30 
tered or data-compressed, additional information indic- 
ative of an electronic watermark (electronic watermark 
information) added thereto can be detected from the fil- 
tered or compressed video signal or audio signal. 
[0004] With the foregoing copy control scheme uti- 35 
lizing the watermark processing, added additional infor- 
mation may represent four conditions: 

(1) "Copy Free"; 

(2) "Copy Once"; 40 

(3) "No More Copy"; and 

(4) "Never Copy" 

so as to set forth the copy generation and copy limiting 
conditions for video signals and audio signals on which 45 
the electronic watermark information is embedded. 
[0005] (1) "Copy Free" indicates that audio signals 
and video signals may be freely copied. (2) "Copy 
Once" indicates that audio signals and video signals 
may be copied only once. (3) "No More Copy" indicates 50 
that audio signals and video signals are not allowed to 
be copied any more because the audio signals and 
video signals which might be copied once already (in 
the (2) state). (4) "Never Copy" indicates that copies are 
absolutely prohibited. 55 
[0006] With such electronic watermark information 
indicative of a copy generation and copy limiting condi- 
tions added to a video signal or an audio signal, when 



the video signal or the audio signal is to be copied, the 
electronic watermark information added to the video 
signal or the audio signal to be copied is detected in a 
recording apparatus. Then, the recording may be con- 
trolled in accordance with the copy generation and copy 
limiting conditions indicated by the detected electronic 
watermark information to ensure that content informa- 
tion such as video signals and audio signals are pro- 
tected from unauthorized copies. 

[0007] Recently, however, there is an increasing 
request for embedding, as electronic watermark infor- 
mation, a variety of further additional information (addi- 
tional data) such as copyright information, in addition to 
the copy control information, on content information. 
[0008] As an example of additional data, if copyright 
information to specify a copyright owner is embedded 
on content information as electronic watermark informa- 
tion, this may be detected as required to identify the 
copyright owner. Therefore, even if the content informa- 
tion on which the copyright information is embedded as 
electronic watermark information is illegally copied, the 
copyright information added as electronic watermark 
information may be detected from the illegally copied 
content information to identify the legal copyright owner, 
thereby making it possible to facilitate the exposure of 
unauthorized copies. 

[0009] As mentioned above, the additional data is 
not such highly significant information that is always 
required upon copy, like the copy control information, 
but is relatively less significant information which is suf- 
ficient if it can be detected as required. 
[0010] In the case where plural pieces of additional 
information having different significance degrees, like 
copy control information and additional data, are 
embedded on content information as electronic water- 
mark information, the electronic watermark information 
indicating the more significant additional information, for 
example, the electronic watermark information indicat- 
ing the copy control information may be detected with 
difficulties. In this case, the difficulties in detection 
would cause an additional problem of a failure in reliable 
and rapid copy control. 

[0011] In view of the foregoing, an object of at least 
preferred embodiments of this invention have been 
achieved by the provision of an additional information 
embedding apparatus and method for embedding plural 
pieces of additional information having different signifi- 
cance degrees on a video signal as electronic water- 
mark information so that higher significant additional 
information can be more reliably and more rapidly 
detected, and of an additional information detecting 
apparatus and method for detecting the additional infor- 
mation embedded on the video signal as electronic 
watermark information. 

[0012] Various aspects of the invention are set out 
in the appended claims. 

[0013] The additional information detecting appara- 
tus and method according to at least preferred embodi- 
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ments of the present invention is to generate plural 
pieces of additional information to be embedded on a 
signal, to convert each of the additional information into 
electronic watermark information, to control the size of 
the embedding area for each of the electronic water- 5 
mark information in accordance with the significance 
degree of the corresponding additional information, and 
to embed the electronic watermark information on the 
signal based on the control signal. 

[0014] In the additional information embedding 10 
apparatus and method according to at least preferred 
embodiments of the present invention, in the case 
where plural pieces of additional information having dif- 
ferent significance degrees are embedded on a video 
signal as electronic watermark information, the size of a 15 
embedding area on for embedding additional informa- 
tion having a higher significance degree as electronic 
watermark information is set so as to be larger than the 
size of a embedding area for embedding additional 
information having a lower significance degree as elec- 20 
tronic watermark information. 

[0015] In this way. additional information, when 
embedded on a video signal as electronic watermark 
information, can be embedded on the video signal so 
that additional information having a higher significance 25 
degree is easier to detect. 

[0016] Further, in the additional information detect- 
ing apparatus and method according to at least pre- 
ferred embodiments of the present invention, in the 
case where each of plural pieces of additional informa- 30 
tion is detected from a signal having the plural pieces of 
additional information embedded thereon as electronic 
watermark information, the electronic watermark infor- 
mation indicating the plural pieces of additional informa- 
tion are separately embedded in embedding areas, 35 
which are set in accordance with the significance 
degrees of the corresponding additional information. 
And additional information indicated by electronic 
watermark information is detected from each embed- 
ding area, and a detection timing for detecting additional <*o 
information is generated every embedding area which is 
set in accordance with the significance degree of the 
corresponding additional information to utilize the above 
detection. 

[0017] In the additional information detecting appa- 45 
ratus and method according to at least preferred 
embodiments of the present invention, a embedding 
area for embedding an additional information having 
higher significance degree as electronic watermark 
information is set to be larger. Then, additional informa- so 
tion embedded as electronic watermark information is 
detected from each embedding area. 
[0018] This ensures to reliably detect each of plural 
pieces of additional information having different signifi- 
cance degrees embedded on a video signal as elec- 55 
tronic watermark information, wherein additional 
information having a higher significance degree can be 
more reliably and rapidly detected. 



[0019] Embodiments of the invention will now be 
described, byway of example only, with reference to the 
accompanying drawings in which: 

Fig. 1 is a block diagram explaining an authoring 
apparatus to which an embodiment of an additional 
information embedding method and additional 
information embedding apparatus according to one 
example of the present invention are applied; 
Figs. 2A and 2B are diagrams explaining two pieces 
of information having different significance degrees 
which are embedded on a video signal in the 
authoring apparatus illustrated in Fig. 1; 
Fig. 3 is a diagram explaining embedding areas for 
embedding two pieces of additional information 
having different significance degrees on a video 
signal as electronic watermark information in the 
authoring apparatus illustrated in Fig. 1; 
Fig. 4 is a block diagram explaining a timing control- 
ler in the authoring apparatus illustrated in Fig. 1; 
Figs. 5A to 5H are diagrams explaining timing sig- 
nals which are generated in the timing controller; 
Figs. 6A to 6D are diagrams explaining the relation- 
ship between additional information embedded on 
a video signal as electronic watermark information 
(spread spectrum signal) and the video signal as an 
information signal. 

Fig. 7 is a block diagram explaining a record- 
ing/reproducing apparatus to which an embodiment 
of an additional information detecting method and 
additional information detecting apparatus accord- 
ing to one example of the present invention is 
applied; 

Fig. 8 is a block diagram explaining a WM decoder 
in the recording/reproducing apparatus illustrated in 
Fig. 7; 9 

Fig. 9 is a diagram explaining another example of 
embedding parts for embedding two pieces of addi- 
tional information having different significance 
degrees on a video signal as electronic watermark 
information; 

Figs. 10A to 10G are diagrams explaining timing 
signals used for embedding additional information 
as electronic watermark information on the embed- 
ding parts shown in Fig. 9, and for detecting the 
additional information; 

Fig. 11 is a diagram explaining another example of 
embedding parts for embedding two pieces of addi- 
tional information having different significance 
degrees on a video signal as electronic watermark 
information; and 

Figs. 12A to 12G are diagrams explaining timing 
signals used for embedding additional information 
as electronic watermark information on the embed- 
ding parts shown in Fig. 11, and for detecting the 
additional information. 

[0020] Preferred embodiments of this invention will 
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be described with reference to the accompanying draw- 
ings: 

[0021] In the following, an additional information 
embedding method, additional information detecting 
method, additional information embedding apparatus 5 
and additional information detecting apparatus will be 
described in connection with their respective embodi- 
ments with reference to the accompanying drawings. 
[0022] In the embodiments described below, the 
additional information embedding method and addi- w 
tional information embedding apparatus according to 
the present invention will be described as applied to a 
so-called authoring apparatus for creating a digital 
video disc (hereinafter abbreviated as the "DVD") which 
has video signals recorded thereon. On the other hand, 15 
the additional information detecting method and addi- 
tional information detecting apparatus according to the 
present invention will be described as applied to a 
recording/reproducing apparatus which has a dubbing 
function for reproducing video signals recorded on a 20 
DVD to copy the reproduced video signals on another 
recording medium, for example, a data rewritable DVD 
or the like. 

[0023] Here, the authoring apparatus is used on the 
content information provider which records content 25 
information (information signals) such as video signals 
and audio signals on DVDs for distribution, while the 
recording/reproducing apparatus having a dubbing 
function is provided for consumers' family use. 
[0024] As will be also described later, on a video 30 
signal to be recorded on a DVD by the authoring appa- 
ratus, plural pieces of additional information having dif- 
ferent significance degrees are embedded as electronic 
watermark information. In the embodiments described 
below, the electronic watermark information is imple- 35 
mented as a spread spectrum signal which is formed by 
a spread spectrum using a Pseudorandom Noise (PN) 
sequence code (hereinafter referred to as the "PN 
code"). 

[0025] While in the embodiments explained below, 40 
the authoring apparatus and the recording/reproducing 
apparatus having a dubbing function are also capable of 
processing audio signals as well as video signals, and 
the explanation on an audio signal system will be omit- 
ted for simplifying the description. -J5 

[First Embodiment] 

[About Authoring Apparatus] 

50 

[0026] Fig. 1 is a block diagram explaining an 
authoring apparatus according to this embodiment. As 
illustrated in Fig. 1, the authoring apparatus of this 
embodiment comprises: an analog video signal input 
terminal 1 ; an A/D converter 2: a synchronization detec- 55 
tor 3; a timing controller 4: a first PN generator 5; a first 
additional information generator 6; a second PN gener- 
ator 7; a second additional information generator 8: 



spreaders 9. 10; a weighting combiner 11; a level 
adjuster 12; an electronic watermark information 
embedding section (hereinafter referred to as the "WM 
embedding section." WM is an abbreviation of elec- 
tronic watermark information) 13; a data compression 
processor 14; an encryption section 15; a recording 
processor 16; a controller 17; and a key manipulation 
unit 18. A recording medium 100 is a DVD in this 
embodiment. 

[0027] In the authoring apparatus of this embodi- 
ment, the controller 17 may be a microcomputer which 
includes a CPU. a ROM. a RAM and so on. The control- 
ler 17 can control each section of this authoring appara- 
tus in accordance with instructions which are input with 
the key manipulation unit 18 by a user. 
[0028] The authoring apparatus of this embodiment 
is configured to embed two pieces of additional informa- 
tion having different significance degrees, i.e.. first addi- 
tional information having a higher significance degree 
and second additional information having a significance 
degree lower than that of the first additional information, 
as electronic watermark information on a video signal 
within one frame screen (within one frame) which is 
recorded on the DVD 100. This embodiment will first be 
explained for the two pieces of additional information 
having different significance degrees which are embed- 
ded on the video signal. 

[0029] Figs. 2A and 2B are diagrams explaining the 
first additional information and the second additional 
information which have different significance degrees 
from each other and are embedded on a video signal to 
be recorded on the DVD 100 as electronic watermark 
information by the authoring apparatus illustrated in Fig. 
1 . 

[0030] In this embodiment, the first additional infor- 
mation having a higher significance degree is informa- 
tion about copy control, as shown in Fig. 2A. This 
information about copy control is information for control- 
ling copies of a video signal, which must be reliably and 
rapidly detected from the video signal to be copied, on 
execution of a copy. The second additional information 
having a lower significance degree than the first addi- 
tional information is so-called additional data including 
copyright information or the like. This additional informa- 
tion is required to be detected only when required. 
[0031] The information about copy control and the 
additional data are both 4-bit information in this embod- 
iment, and the information about copy control is com- 
prised of copy control information for limiting the copy 
generation mainly for a digital video signal, and analog 
protection system (APS) information for preventing cop- 
ies of an analog video signal, as shown in Fig. 2A. 
[0032] In this embodiment, the copy control infor- 
mation indicates any of the four conditions: (1) "Copy 
Free"; (2) "Copy Once"; (3) "No More Copy"; and (4) 
"Never Copy." as described above. In this embodiment, 
these conditions are represented by two bits as follows: 
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(00) (1) "Copy Free"; 
(10] (2) "Copy Once"; 
[01] (3) "No More Copy"; and 
[11] (4) "Never Copy" 

[0033] The APS information in turn is information 
for controlling insertion of a pseudo synchronization 
pulse into an analog video signal for AGC control, and 
for controlling an inverse burst for color stripe, and is 
represented by two bits. 

[0034] With the copy control information and the 
APS information embedded on a digital video signal as 
described above, even if the digital video signal is con- 
verted into an analog video signal for copy, the copied 
analog video signal, when reproduced, cannot produce 
a normal reproduced image due to the pseudo synchro- 
nization pulse for AGC control and the inverse burst for 
color stripe. That is, even if the digital video signal could 
be copied, no normal image can be reproduced, so that 
the copied analog video signal cannot be utilized, 
thereby protecting the benefit of the copyright owner of 
the video signal from infringement. 
[0035] Fig. 2B is a correspondence table which 
relates ON/OFF control for insertion of the AGC syn- 
chronization pulse and the burst inverse control for color 
stripe correspondingly to a combination of the copy con- 
trol information and the APS information. As described 
above, the authoring apparatus of this embodiment 
embeds the information about copy control, composed 
of the copy control information and the APS information, 
as the first additional information having the higher sig- 
nificance degree on a video signal as electronic water- 
mark information, in order to more securely protect the 
benefit of the copyright owner of the video signal. 
[0036] Further, in the authoring apparatus illus- 
trated in Fig. 1 , the first additional information generator 
6 is a section which generates the more significant infor- 
mation about copy control composed of the copy control 
information and the APS information, as will be also 
described below. The information about copy control, 
which is generated in the first additional information 
generator 6. is spread by the spreader 9 using a first PN 
code generated by the first PN generator 5. to form 
electronic watermark information (spread spectrum sig- 
nal) indicating the information about copy control. 
[0037] Also, in the authoring apparatus illustrated in 
Fig. 1, the second additional information generator 8 is 
a section which generates additional data. The addi- 
tional data generated by the second additional informa- 
tion generator 8 is spread by the spreader 10 using a 
second PN code generated by the second PN generator 
7, to form electronic watermark information (spread 
spectrum signal) indicating the additional data. 
[0038] However, it is considered that if the informa- 
tion about copy control and the additional data are sep- 
arately embedded on a video signal in one screen as 
electronic watermark information, it is contemplated 
that the information about copy control, having a higher 



significance degree, may be detected with difficulties, 
causing disadvantages that it takes a long time to 
appropriately control the copy. 

[0039] To eliminate such disadvantages, it is con- 
5 sidered that the information about copy control is given 
a embedding level (adding intensity) higher than the 
embedding level of the additional data. That is, the elec- 
tronic watermark information indicating the more signif- 
icant additional information is embedded on content 
w information with a higher embedding level than the elec- 
tronic watermark information indicating the less signifi- 
cant additional information. Therefore, the electronic 
watermark information indicating the more significant 
additional information can be reliably and rapidly 
15 detected. 

[0040] However, in the case where the content 
information is a video signal, the embedding level vary- 
ing in accordance with the significance degree of addi- 
tional information would cause a difference in level 

20 between a reproduced image of a video signal part in 
which electronic watermark information indicating more 
significant information is embedded and a reproduced 
image of a video signal part in which electronic water- 
mark information indicating relatively less significant 

25 information is embedded, which causes a problem in 
that a reproduced image is easily deteriorated, for 
example, viewers visually recognizes the level differ- 
ence. 

[0041] To avoid this problem, the authoring appara- 
30 tus of this embodiment separately embeds electronic 
watermark information indicating the more significant 
information about copy control and electronic water- 
mark information indicating the additional data, on 
embedding parts of a video signal. In this event, the 
35 embedding parts are determined such that a part for the 
electronic watermark information indicating the informa- 
tion about copy control having a higher significance 
degree is larger than a part for the electronic watermark 
information indicating the additional data. 
40 [0042] Fig. 3 is a diagram explaining a embedding 
part in which the electronic watermark information indi- 
cating the more significant information about copy con- 
trol is embedded (first embedding part AR1), and a 
embedding part in which the electronic watermark infor- 
ms mation indicating the less significant additional data is 
embedded (second embedding part AR2). in the 
authoring apparatus of this embodiment. 
[0043] In the authoring apparatus of this embodi- 
ment, the first embedding part AR1 and the second 
so embedding part AR2 are set in one screen such that the 
embedding part for the information concerning the more 
significant copy control (first embedding part AR1) is 
larger than the embedding part for the less significant 
additional data (second embedding part AR2). Specifi- 
55 cally, in this embodiment, the first embedding part AR1 
is previously set to be twice the second embedding part 
AR2. 

[0044] Then, as shown in Fig. 3, the information 
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about copy control having a higher significance degree 
is embedded in the first embedding part AR1 as elec- 
tronic watermark information, and the additional data is 
embedded in the second embedding part AR2 as elec- 
tronic watermark information, for each .screen (one 
frame) FL of a video signal. 

[0045] In this way, in the case where plural pieces of 
additional information having different significance 
degrees are embedded on a video signal as electronic 
watermark information, the embedding part in which the 
more significant additional information is embedded as 
electronic watermark information is set larger than the 
embedding part in which the less significant additional 
information is embedded as electronic watermark infor- 
mation, so that the more significant additional informa- 
tion can be more reliably and rapidly detected from the 
additional information embedded on the video signal. 
[0046] In the following, the authoring apparatus of 
this embodiment illustrated in Fig. 1 will be explained in 
detail. An analog video signal to be recorded on the 
DVD 100 is supplied to the A/D converter 2 and the syn- 
chronization detector 3 through the input terminal 1. 
The A/D converter 2 converts the supplied analog video 
signal into a digital video signal which is then supplied to 
the WM embedding section 13. 

[0047] The synchronization detector 3, in turn, 
detects a vertical synchronization signal V and a hori- 
zontal synchronization signal H from the supplied ana- 
log video signal, and supplies these vertical 
synchronization signal V and horizontal synchronization 
signal H to the timing controller 4. The timing controller 
4 utilizes the vertical synchronization signal V and the 
horizontal synchronization signal H as reference signals 
to generate a variety of timing signals such as a PN 
code reset timing signal RE; a first PN generation ena- 
ble signal EN1; a second PN generation enable signal 
EN2; a PN clock signal PNCLK: and a combination tim- 
ing signal SW. 

[0048] Here, the PN code reset timing signal (here- 
inafter simply referred to as the "reset signal") RE indi- 
cates a timing at which the generation of a PN code is 
started. The first PN generation enable signal (hereinaf- 
ter simply referred to as the "first enable signal") EN1 in 
turn indicates an-interval of generating a first PN code 
for performing spread spectrum on the information 
about copy control as the more significant first addi- 
tional information. 

[0049] Similarly, the second PN generation enable 
signal (hereinafter simply referred to as the "second 
enable signal") EN2 indicates an interval of generating a 
second PN code used for performing the spread spec- 
trum on the additional data as the second additional 
information which is less significant than the first addi- 
tional information. 

[0050] In this embodiment, the PN clock signal 
PNCLK indicates a timing at which one chip of the first 
and second PN codes each is generated. For example, 
the PN clock signal PNCLK generates one chip of PN 



code every pixel. 

[0051] The combination timing signal SW in turn 
indicates a timing at which the electronic watermark 
information indicating the information about copy con- 

5 trol and the electronic watermark information indicating 
the additional data are combined such that they can be 
separately embedded in the first embedding part AR1 
and the second embedding part AR2, respectively, 
which have been defined for each one-frame screen FL 

w of the video signal, as shown in Fig. 3. 

[0052] Fig. 4 is a block diagram explaining the tim- 
ing controller 4 for generating a variety of timing signals 
for controlling timings of processing in each section of 
the authoring apparatus. Fig. 5 is a diagram explaining 

15 principal timing signals generated by the timing control- 
ler 4. Specifically, in Figs. 5A to 5H, Fig. 5B and Fig. 5D 
both illustrate the horizontal synchronization signal H. 
where Fig. 5D illustrates the enlarged view of the hori- 
zontal synchronization signal illustrated in Fig. 5B. 

20 [0053] As illustrated in Fig. 4, the timing controller 4 
comprises a PN generation timing signal generator 41; 
a PN clock signal generator 42 comprised of a PLL; and 
a timing signal generator 43. 

[0054] The PN generation timing signal generator 
25 41 uses the vertical synchronization signal V as a refer- 
ence signal to generate a reset signal RE having a 
frame period for defining a cyclic period for a spreading 
PN code sequence for use in the spread spectrum, as 
illustrated in Fig. 5A. In this example, the reset signal 
30 RE is a signal having a period equal to one frame which 
falls, for example, at a leading edge of the vertical syn- 
chronization signal V. 

[0055] The PN generation timing signal generator 
41, in this example, also uses the vertical synchroniza- 
35 tion signal V and the horizontal synchronization signal H 
to generate the first enable signal EN1 and the second 
enable signal EN2. 

[0056] In this example, the first enable signal EN1 is 
a signal which falls at a leading edge of the horizontal 

40 synchronization signal H (see Fig. 5D), and has a low 
level during the former two-third interval of the horizon- 
tal line and has at a high level during the subsequent 
one-third interval, as illustrated in Fig. 5E. 
[0057] The second enable signal EN2 in turn is a 

45 signal which rises at a leading edge of the horizontal 
synchronization signal H (see Fig. 5D), and has a high 
level during the former two-third interval of the horizon- 
tal line, and has a low level during the subsequent one- 
third interval, as illustrated in Fig. 5F. 

50 [0058] For generating the first enable signal EN1 
and the second enable signal EN2, the intervals during 
which the signals have low levels or the intervals can be 
set as described above by frequency dividing the hori- 
zontal synchronization signal H. Also in this embodi- 

55 ment. the first enable signal EN1 and the second enable 
signal EN2 are both low active. 

[0059] Therefore, in each horizontal line period in 
the vertical direction, the information about copy control 
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having a higher significance degree may be subjected 
to the spread spectrum in the former two-third interval, 
and the additional data may be subjected to the spread 
spectrum in the subsequent one-third interval, as will be 
also described later. 

[0060J The PN clock generator 42 uses the PLL to 
generate the PN clock PNCLK (see Fig. 5C) which is 
synchronized with the horizontal synchronization signal 
H. The timing signal generator 43 in turn generates a 
variety of timing signals for use in the authoring appara- 
tus of Fig. 1 on the basis of the vertical synchronization 
signal V and the horizontal synchronization signal H. In 
this embodiment, the timing signal generator 43 gener- 
ates the combination timing signal SW (see Fig. 5G) 
indicative of a timing for combining the electronic water- 
mark information indicating the more significant infor- 
mation about copy control and the electronic watermark 
information indicating the additional data. 
[0061] Then, out of the signals generated in the tim- 
ing controller 4. the reset signal RE. the first enable sig- 
nal EN1 and the PN clock signal PNCLK are supplied to 
the first PN generator 5, and the first enable signal EN1 
and the PN clock signal PNCLK are also supplied to the 
first additional information generator 6. 
[0062] The reset signal RE. the second enable sig- 
nal EN2 and the PN clock signal PNCLK are supplied to 
the second PN generator 7, and the second enable sig- 
nal EN2 and the PN clock signal PNCLK are also sup- 
plied to the second additional information generator 8. 
Further, the combination timing signal SW is supplied to 
the weighting combiner 1 1 . 

[0063] In this embodiment, the first PN generator 5 
and the second PN generator 7 are comprised of multi- 
stage shift registers, although not shown, each is com- 
prised of several exclusive OR circuits for calculating 
appropriate tap outputs for the shift registers, in order to 
generate a PN code sequence based on the timing sig- 
nal from the timing controller 4. 

[0064] More specifically, the first PN generator 5 
generates a first PN code sequence PS1 in response to 
the reset signal RE. the first enable signal EN1 and the 
clock signal PNCLK. The first PN generator 5 is reset by 
the reset signal RE at every frame period, in this exam- 
ple, such that the PN code sequence PS1 having a pre- 
determined code pattern can be generated from its 
beginning. Then, the first PN generator 5 generates the 
PN code sequence PS1 in response to the clock signal 
PNCLK only when it is brought into a PN code genera- 
tion enabled state (enable state) by the first enable sig- 
nal EN1. 

[0065] In this example, as has been also described 
above, the first PN generator 5 is brought into the state 
in which it can generate the first PN code sequence PS1 
when the first enable signal EN1 is at a low level. Thus, 
as illustrated in Fig. 5E, the first PN generator 5 is into 
the PN code generating state during the two-third inter- 
val of one horizontal line from the leading edge of the 
horizontal synchronization signal H in each horizontal 



line period in the vertical direction in each one-frame 
screen, and generates the PN codes at a rate of one 
chip per one clock of the clock signal PNCLK. In this 
way. the first PN code sequence PS1 generated in the 
5 first PN generator 5 is supplied to the spreader 9. 

[0066] The first additional information generator 6. 
on the other hand, generates an information sequence 
FS1 related to the copy control, comprised of the copy 
control information and the APS information, as the first 
w additional information having a higher significance 
degree which is to be embedded on a video signal 
inputted via the input terminal 1 through spread spec- 
trum, based on the clock PNCLK at a timing of the first 
enable signal EN1 from the timing controller 3, and sup- 
15 plies the information sequence FS1 to the spreader 9. In 
other words, the first additional information generator 6 
generates the information sequence FS1 related to the 
copy control at the same timing as the first PN code 
sequence PS1 . and supplies it to the spreader 9. 
20 [0067] Similarly, the second PN generator 7 gener- 
ates the second PN code sequence PS2 in response to 
the reset signal RE. the second enable signal EN2 and 
the clock signal PNCLK. The second PN generator 7 is 
also reset by the reset signal RE at every frame period, 
25 so as to generate the PN code sequence PS2 having a 
predetermined code pattern from its beginning. Then, 
the second PN generator 7 generates the PN code 
sequence PS2 in response to the clock signal PNCLK 
only when it is brought into a PN code generation ena- 
30 bled state (enable state) by the second enable signal 
EN2. 

[0068] Therefore, the second PN generator 7 is 
brought into the state in which it can generate the sec- 
ond PN code sequence PS2 when the second enable 
35 signal EN2 is at a low level. Thus, as illustrated in Fig. 
5F. the second PN generator 7 is in the PN code gener- 
ating state in the latter one-third interval of each hori- 
zontal line in each horizontal line period in the vertical 
direction in each screen, and generates the PN codes at 
40 a rate of one chip per one clock of the clock signal 
PNCLK. In this way, the second PN code sequence PS2 
generated in the second PN generator 7 is supplied to 
the spreader 10. 

[0069] The second additional information generator 
45 8, on the other hand, generates an additional data 
sequence FS2 which is to be embedded on a video sig- 
nal inputted via the input terminal 1 through the spread 
spectrum, based on the clock PNCLK at a timing of the 
second enable signal EN2 from the timing controller 3. 
so and supplies the additional data sequence FS2 to the 
spreader 10. In other words, the second additional infor- 
mation generator 8 generates the additional data 
sequence FS2 at the same timing as the second PN 
code sequence PS2. and supplies it to the spreader 10. 
55 [0070] In the authoring apparatus of this embodi- 
ment, the user can give instructions concerning infor- 
mation about copy control generated in the first 
additional information generator 6 and the additional 
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data generated in the second additional information 
generator8. with the key manipulation unit 18. 
[0071] Specifically, when the user specifies, with 
the key manipulation unit 18. information about copy 
control and additional data and additional data, which 
are embedded on a video signal as electronic water- 
mark information, the controller 17 can control the first 
additional information generator 6 and the second addi- 
tional information generator 8 so as to generate the 
specified information. 

[0072] The spreader 9 performs the spread spec- 
trum on the information sequence FS1 concerning the 
copy control with the first PN code sequence PS1. to 
form electronic watermark information SS1 indicating 
the information about copy control, and supplies this to 
the weighting combiner 11. Similarly, the spreader 10 
performs the spread spectrum on the additional data 
sequence FS2 with the second PN code sequence PS2 
to form electronic watermark information SS2 indicating 
the additional data, and supplies this to the weighting 
combiner 1 1 . 

[0073] The weighting combiner 11 which has a 
function as an electronic watermark information com- 
bining means, combines the electronic watermark infor- 
mation SS1 indicating the information about copy 
control and the electronic watermark information SS2 
indicating the additional data, based on the combination 
timing signal SW from the timing controller 4, to form a 
combined electronic watermark information signal (see 
Fig. 5H) which is to be embedded on a video signal 
inputted via the input terminal 1. 

[0074] In this embodiment, the weighting combiner 
11 outputs the electronic watermark information SS1 
indicating the information about copy control while the 
combination timing signal SW illustrated in Fig. 5G is at 
a low level, and outputs the electronic watermark infor- 
mation SS2 indicating the additional data while the com- 
bination timing signal SW is at a high level, in each 
horizontal line period in the vertical direction, thereby 
forming a combination signal of the electronic water- 
mark information SS1 indicating the information about 
copy control and the electronic watermark information 
SS2 indicating the additional data as shown in Fig. 5H. 
The combination signal is supplied to the level adjuster 
12. 

[0075] The level adjuster 12 adjusts a embedding 
level of the combined electronic watermark information 
signal such that the embedding of the combined elec- 
tronic watermark information signal on the video signal 
does not deteriorate an image reproduced from the 
video signal. In this embodiment, the level adjuster 12 
adjusts the embedding level such that the combined 
electronic watermark information signal is embedded at 
a level lower than the dynamic range of the video signal. 
[0076] In this event, while the combined electronic 
watermark information signal is a combination signal of 
the electronic watermark information SS1 indicating the 
information about copy control and the electronic water- 



mark information SS2 indicating the additional data, as 
described above, the electronic watermark information 
SS1, SS2 can be separately embedded in the embed- 
ding parts of the video signal at the same embedding 
5 levels. The combination signal having the adjusted level 
is supplied from the level adjuster 12 to the WM embed- 
ding section 13. 

[0077] The WM embedding section 13 embeds the 
combined electronic watermark information signal sup- 

w plied through the level adjuster 12 on the video signal 
supplied from the input terminal 1. The video signal on 
which the electronic watermark information signal is 
embedded by the WM embedding section 13 is supplied 
to the data compression processor 14. 

75 [0078] The data compression processor 14 com- 
presses data in the supplied video signal having the 
electronic watermark information signal embedded 
thereon in accordance with the MPEG scheme. The 
data-compressed video signal is supplied to the encryp- 

20 tion section 15. In this embodiment, the encryption sec- 
tion 15 performs encryption processing in accordance 
with a content scramble system (CSS) on the video sig- 
nal. The CSS-based encryption processing is the one 
which is applied to information signals when information 

25 signals such as video signals are recorded on a disc 
medium such as a DVD for distribution. 
[0079] The video signal subjected to the encryption 
processing in the encryption section 15 is supplied to 
the recording processor 16. The recording processor 16 

30 performs adjustment processing and so on for recording 
a video signal on the DVD 100, on the supplied video 
signal to record it on the DVD 100. 

[0080] As a result, the video signal on which the 
information about copy control having a higher signifi- 
es cance degree (four bits) and the additional data (four bit) 
having a lower significance degree than the information 
about copy control is embedded as the electronic water- 
mark information is recorded on the DVD 100. 
[0081] In this case, as been previously described 
40 with reference to Fig. 3, the embedding part for the elec- 
tronic watermark information SS1 indicating the more 
significant information about copy control is set larger 
than the embedding part for the electronic watermark 
information SS2 indicating the additional data. In this 
45 way. the embedding parts, in which the additional infor- 
mation are embedded as electronic watermark informa- 
tion, are set in accordance with the significance degrees 
of the additional information. However, the electronic 
watermark information SS1 indicating the information 
50 about copy control and the electronic watermark infor- 
mation SS2 indicating the additional data are embed- 
ded on a video signal at the same embedding level. 
[0082] Figs. 6A to 6D spectrally illustrates a rela- 
tionship between additional information embedded on a 
55 video signal as electronic watermark information, for 
example, information about copy control, additional data 
and so on, and an information signal such as a video 
signal. The additional information such as information 
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about copy control and additional data is a low bit rate 
signal which includes a small amount of information, 
and therefore is a narrow band signal as illustrated in 
Fig. 6A. The additional information becomes a wide 
bandwidth signal as illustrated in Fig. 6B by the spread 
spectrum. In this event, the spread spectrum signal 
level becomes smaller in reciprocal proportion to a band 
enlarging ratio. 

[0083] This spread spectrum signal, i.e.. the elec- 
tronic watermark information is embedded on a video 
signal in the WM embedding section 13. in which case 
the electronic watermark information is embedded at a 
level lower than the dynamic range of the video signal 
as an information signal, as illustrated in Fig. 6C. Such 
embedding can substantially completely prevent the 
information signal from degrading. Thus, as described 
above, when the video signal on which the electronic 
watermark information is embedded is supplied to a 
monitor to reproduce an image thereon, a reproduced 
image is hardly affected by the electronic watermark 
information and hence is satisfactorily provided. 
[0084] As will be described later, when de-spread 
spectrum is performed to detect electronic watermark 
information, the electronic watermark information is 
returned as a narrow band signal as illustrated in Fig. 
6D. By using a sufficient band spreading ratio, the de- 
spread additional information has larger power than the 
information signal, and is therefore detectable. 
[0085] In this event, since electronic watermark 
information embedded on a video signal is embedded 
for the same duration of time and at the same frequency 
as the video signal, the electronic watermark informa- 
tion could not be eliminated or modified by simply 
replacing a frequency filter or information. 
[0086] Therefore, the electronic watermark informa- 
tion embedded on the video signal cannot be removed, 
and is changed with difficulties, so that it can be 
ensured that the video signal is protected from unau- 
thorized copies by using the information about copy 
control embedded on the video signal as electronic 
watermark information. 

[0087] Then, as has been also described above, 
when plural pieces of additional information are embed- 
ded as electronic watermark information with different 
embedding levels, it is considered that levels may be dif- 
ferent between a reproduced image of a video signal 
part having additional information embedded therein at 
a higher embedding level and a reproduced image of a 
video signal part having additional information embed- 
ded therein at a lower embedding level, thereby causing 
a degradation in a reproduced image. The authoring 
apparatus of this embodiment, on the other hand, 
embeds two pieces of additional information having dif- 
ferent significance degrees on a video signal at the 
same embedding level as electronic watermark infor- 
mation, so that it is possible to prevent the embedding of 
the electronic watermark information on the video signal 
from degrading the reproduced image of the video sig- 



nal. 

[0088] Also, in the authoring apparatus of this 
embodiment, the embedding part in which the more sig- 
nificant first additional information is embedded as elec- 

5 tronic watermark information is set larger than the 
embedding part in which the second additional informa- 
tion having a lower significance degree than the first 
additional information is embedded as electronic water- 
mark information. 

w [0089] Therefore, with respect to additional informa- 
tion embedded in the same screen, the more significant 
additional information which is embedded in the larger 
area of the video signal can be more reliably and rapidly 
detected than the less significant additional information. 

15 [0090] Further, with respect to the less significant 
additional information, which is embedded in a smaller 
embedding part than the more significant additional 
information, the embedding part is previously set, so 
that the less significant additional information can also 

20 be reliably detected, although a slightly longer detection 
time is required therefor. 

[0091] As described above, the authoring appara- 
tus of this embodiment can embed two pieces of addi- 
tional information having different significance degrees 
25 on a video signal in such a manner that a reproduced 
image will not be degraded and the more significant 
additional information can be more reliably and rapidly 
detected. 

30 [About Recording/Reproducing Apparatus Having Dub- 
bing Function] 

[0092] Fig. 7 is a block diagram for explaining a 
recording/reproducing apparatus of this embodiment. 

35 As has been also described above, the recording/repro- 
ducing apparatus of this embodiment reads a video sig- 
nal recorded on a DVD for reproduction, and has a so- 
called dubbing function for duplicating the read video 
signal on a data rewritable recording medium. 

40 [0093] As illustrated in Fig. 7, the recording/repro- 
ducing apparatus of this embodiment comprises: a 
reader 21; a decryption section 22; a video data 
decoder 23; a D/A converter 24; an analog video signal 
output terminal 25; an electronic watermark information 

45 decoder (hereinafter simply referred to as the "WM 
decoder") 26; a recording controller 27; an encryption 
section 28; a recording processor 29; a controller 30; 
and a key manipulation unit 31. 

[0094] A DVD 100 has recorded thereon a video 
50 signal on which information about copy control and 
additional data are embedded as electronic watermark 
information by the authoring apparatus previously 
described with reference to Fig. 1. A disc 200 is data 
rewritable. 

55 [0095] When the user gives a command to execute 
a dubbing function with the key manipulation unit 31 . the 
reader 21 reads a digital video signal recorded on the 
DVD 100. The read video signal is supplied to the 
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decryption section 22. The decryption section 22 per- 
forms decripting processing for decripting the encripted 
video signal supplied thereto, and supplies the 
decripted video signal to the video data decoder 23. the 
WM decoder 26 and the recording controller 27. 5 
[0096] Since the decripted video signal has been 
subjected to the data compression in accordance with a 
predetermined scheme, for example, the MPEG 
scheme or the like, it is decoded in the video data 
decoder 23'in order to be supplied to. for example, a dis- w 
play monitor device. The decoded video signal is sup- 
plied to the D/A converter 24 which converts the video 
signal to an analog signal. The analog signal is then out- 
putted through the analog video signal output terminal 
25 and supplied to. for example, a display monitor or a 15 
recording device. 

[0097] The WM decoder 26 in turn detects from the 
decripted video signal, information about copy control 
and additional data embedded thereon as electronic 
watermark information. 20 
[0098] Fig. 8 is a block diagram explaining the WM 
decoder 26 in the recording/reproducing apparatus of 
this embodiment. As illustrated in Fig. 8. the WM 
decoder 26 comprises a decoder 261: a synchroniza- 
tion detector 262; a timing controller 263; a first PN gen- 25 
erator 264; a second PN generator 265; a weighting 
combiner 266; a de-spreader 267; and an electronic 
watermark information determination unit (hereinafter 
simply referred to as the "WM determination unit") 268. 
[0099] As has been also described above, the 30 
decripted video signal has been data-compressed in 
accordance with a predetermined scheme. For this rea- 
son, the decoder 261 in the WM decoder 26 decodes 
the supplied video signal to bring the video signal into a 
condition in which the information about copy control 35 
and so on embedded thereon as electronic watermark 
information can be detected therefrom. In this case, the 
decoded video signal is such that a vertical synchroni- 
zation signal V and a horizontal synchronization signal 
H can be detected therefrom for use as reference sig- 40 
nals. Then, the decoded video signal is supplied to the 
synchronization detector 262 and the de-spreader 267. 
[0100] The synchronization detector 262 detects 
the vertical synchronization signal V and the horizontal 
synchronization signal H. for use as reference signals, 45 
from the decoded video signal, and supplies them to the 
timing controller 263. 

[0101] The timing controller 263 is configured sub- 
stantially in a manner similar to the timing controller 4 in 
the authoring apparatus previously described with refer- so 
ence to Figs. 1 and 4. The timing controller 263 in the 
recording/reproducing apparatus generates timing sig- 
nals which provide the same timings as the reset signal 
RE, the first enable signal EN1, the second enable sig- 
nal EN2. the clock signal PNCLK. and the combination 55 
timing signal SW, respectively, which have been used to 
embed electronic watermark information on a video sig- 
nal. 



[0102] Specifically, the timing controller 263 in the 
WM decoder 26 generates the reset signal RE (see Fig. 
5A); the first enable signal EN1 (see Fig. 5E); the sec- 
ond enable signal EN2 (see Fig. 5F); the clock signal 
PNCLK (see Fig. 5C); and the combination timing signal 
SW (see Fig. 5G). in a manner similar to the timing con- 
troller 4 in the authoring apparatus illustrated in Fig. 1. 
[0103] Then, out of the timing signals generated in 
the timing controller 263. the reset signal RE and the 
clock signal PNCLK are supplieoMo the first PN genera- 
tor 264 and the second PN generator 265; the first ena- 
ble signal EN1 to the first PN generator 264; and the 
second enable signal EN2 to the second PN generator 
265. The combination timing signal SW in turn is sup- 
plied to the weighting combiner 266. 
[0104] The first PN generator 264 and the second 
PN generator 265 are configured in a manner similar to 
the first PN generator 5 and the second PN generator 7 
in the authoring apparatus previously described with 
reference to Fig. 1 . 

[0105] The first PN generator 264 is rest every 
frame based on the reset signal RE. the first enable sig- 
nal EN1 and the clock signal PNCLK, and generates a 
first PN code sequence PS1 only while the first enable 
signal EN1 is at a low level (see Fig. 5E). Stated another 
way, the first PN generator 264 generates the first PN 
code sequence PS1 used in the spread spectrum at the 
same timing at which the information about copy control 
is subjected to the spread spectrum to be embedded on 
a video signal. The first PN code sequence PS1 is sup- 
plied to the weighting combiner 266. 
[0106] The second PN generator 265 in turn is 
reset every frame based on the reset signal RE. the 
second enable signal EN2 and the clock signal PNCLK, 
and generates a second PN code sequence PS2 only 
while the second enable signal EN2 is at a low level 
(see Fig. 5F). That is. the second PN generator 265 
generates the second PN code sequence PS2 used in 
the spread spectrum at the same timing at which the 
additional data is subjected to the spread spectrum to 
be embedded on the video signal. The second PN code 
sequence PS2 is also supplied to the weighting com- 
biner 266. 

[0107] The weighting combiner 266. based on the 
combination timing signal (Fig. 5G) from the timing con- 
troller 263, outputs the first PN code sequence PS1 
from the first PN generator 264 while the combination 
timing signal SW is at a low level, and outputs the sec- 
ond PN code sequence PS2 from the second PN gener- 
ator 265 while the combination timing signal SW is at a 
high level. 

[0108] In this way. the first PN code sequence PS1 
used in the spread spectrum of the information about 
copy control, and the second PN code sequence PS2 
used in the spread spectrum of the additional data are 
supplied to the de-spreader 267 for the decoded video 
signal at the same timing as the spread spectrum of the 
information about copy control and the additional data. 
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[0109] The de-spreader 267 uses a combined PN 
code sequence which is a combination of the first PN 
code sequence PS1 and the second PN code sequence 
PS2 from the weighting combiner 266 to extract an 
information sequence FS1 concerning the copy control 
and an additional data sequence FS2 which are sepa- 
rately embedded in embedding parts every one-frame 
screen of the video signal, as previously shown in Fig. 
3. and supplies the extracted sequences to the WM 
determination unit 268. 

[0110] The WM determination unit 268 uses the 
extraction output from the de-spreader 267 to determine 
the type of information about copy control comprised of 
the 4 bits, and the type of additional data comprised of 
4 bits, and supplies the determination results to the con- 
troller 30. 

[0111] In this event, as previously shown in Fig. 3. 
the embedding part AR1 for the information about copy 
control as electronic watermark information is larger 
than the embedding part AR2 for the additional data as 
electronic watermark information. For this reason, the 
information about copy control can be more correctly 
and rapidly detected than the additional data. Of course, 
the additional information can also be detected cor- 
rectly, although a slightly longer time is required therefor 
than for the information about copy control. 
[0112] In this way, the controller 30 can correctly 
and rapidly acquire the information about copy control. 
Then, the controller 30 determines, based on the infor- 
mation about copy control from the WM decoder 26, 
whether the video signal read from the DVD 100 is 
allowed to be copied or not. and controls the recording 
controller 27 based on the determination result. 
[0113] More specifically, the controller 30 forms a 
control signal for prohibiting a copy when it determines 
from the 4-bit copy control information embedded on the 
video signal read from the DVD 100 that 2-bit copy con- 
trol information indicates copy prohibited, and otherwise 
forms a control signal for permitting a copy when it 
determines that the 2-bit copy control information indi- 
cates copy free or one copy permitted (copy of one gen- 
eration permitted). The control signal thus formed is 
supplied to the recording controller 27. 
[0114] The recording controller 27 does not allow 
the decryption section 22 to supply the video signal to 
the encryption section 28 when the control signal from 
the controller 30 indicates recording prohibited. Con- 
versely, the recording controller 27 allows the decryp- 
tion section 22 to supply the video signal to the 
encryption section 28 when the control signal from the 
controller 30 indicates recording permitted. 
[0115] The encryption section 28 receives the sup- 
plied video signal, which has been indicated as copy 
permitted, and encripts the video signal in accordance 
with a predetermined encryption scheme. The video 
signal encripted in the encryption section 28 is supplied 
to the recording processor 29. The recording processor 
29 performs processing for recording the encripted 



video signal on the disc 200. 

[0116] In the manner described above, the informa- 
tion about copy control and the additional data are 
embedded on video signals recorded on the DVD 100 

5 as electronic watermark information. Since the informa- 
tion about copy control having a higher significance 
degree is embedded in the first embedding part AR1 
which is larger than the part AR2 for the additional data, 
the information about copy control can be correctly and 

w rapidly detected from the video signals. Then, based on 
the detected information about copy control, only the 
video signals which are determined as copy permitted 
can be copied on the disc 200 and the video signals 
which are determined as copy prohibited can not be 

15 copied. In this way. it is possible to ensure that the cop- 
yright owner of the video signals is protected from suf- 
fering a loss due to unauthorized copies of the video 
signals. 

[0117] The additional data in turn is embedded in 
20 the second embedding part AR2 which is smaller than 
the embedding part for the information about copy con- 
trol. Since the second embedding part AR2 is proc- 
essed to detect the additional data, the additional data 
embedded on the video signal can be reliably detected 
25 as well. 

[0118] Consequently, even when two pieces of 
additional information having different significance 
degrees are separately embedded in embedding parts 
of one frame screen of a video signal as shown in Fig. 
30 3, the more significant additional information is detected 
without any difficulties and therefore, each of the addi- 
tional information can be reliably detected without any 
difficulties. 

[0119] The recording/reproducing apparatus of this 
35 embodiment illustrated in Fig. 7 can output an analog 
video signal via the output terminal 25. so that it is con- 
sidered that an analog video signal outputted via this 
analog output terminal be supplied to a recording device 
for making a copy. 
40 [0120] However, as described above, the informa- 
tion about copy control is embedded on digital video sig- 
nals recorded on the DVD 100 as an electronic 
watermark information, and the electronic watermark 
information embedded on the digital video signals is 
45 never removed even if the digital video signals are con- 
verted into analog signals. 

[0121] It is therefore possible to extract, in a record- 
ing device which is to be supplied with the analog video 
signals, the information about copy control embedded 
50 as electronic watermark information from the supplied 
analog video signal, and to conduct appropriate copy 
control based on the extracted information about copy 
control. 

[0122] Also, when a digital video signal recorded on 
55 the DVD 100 is outputted as an analog video signal, 
pseudo synchronization pulses for AGC control can be 
inserted or the inverse burst control for color stripe can 
be performed, as shown in Fig. 2B. based on the infor- 
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mation about copy control embedded on the digital 
video signal, i.e.. the copy control information and the 
APS information. 

[0123] In such a case, as has been also described 
above, a normally reproduced image can not be 5 
obtained depending on the copied analog video signal. 
In this case, the information about copy control need not 
be detected from the analog video signal, supplied to a 
recording device, on which the information is embed- 
ded. 10 
[0124] Also, when a video signal outputted from the 
recording/reproducing apparatus of this embodiment or 
copied on the disc 200 is an information signal which 
can be copied once (one generation copy permitted), 
the information about copy control embedded thereon 15 
as electronic watermark information is rewritten, for 
example, in the video data decoder 23 or the recording 
controller 27. or- at any subsequent section so as to pro- 
hibit more copies. 

[0125] The electronic watermark information can be 20 
rewritten, for example, by deleting the information about 
copy control originally embedded on the video signal as 
the electronic watermark information and then embed- 
ding new information about copy control on the video 
signal as electronic watermark information. 
[0126] In this way, the electronic watermark infor- 
mation are uniformly embeddedon the video signal, so 
that there is no difference in level between the embed- 
ding part for the information about copy control and the 
embedding part for the additional data, thereby a repro- 
duced image is prevented from being viewed with diffi- 
culty. 

[Second Embodiment] 

[0127] In a second embodiment, the embedding 
part (first embedding part) AR1 for more significant 
information about copy control and the embedding part 
(second embedding part) AR2 for additional data having 
a lower significance degree than the information about 
copy control are defined such that they are separated in 
the vertical direction every one-frame screen of a video 
signal. 

[0128] When the embedding parts for additional 
information having different significance degrees are 
defined as separate parts in the vertical direction every 
one-frame screen of a video signal as mentioned above, 
an authoring apparatus for recording a video signal on 
which additional information having different signifi- 
cance degrees are embedded as electronic watermark 
information, on a recording medium, for example, a 
DVD or the like can be also configured in a similar man- 
ner to the authoring apparatus illustrated in Fig. 1 . 
[0129] For this reason, the authoring apparatus of 
the second embodiment will be explained as configured 
similarly to the authoring apparatus illustrated in Fig. 1. 
with reference also to Fig. 1. The second embodiment, 
however, differs from the first embodiment in timing sig- 



nals generated in the timing controller 4, as described 
below. 

[0130] Fig. 9 is a diagram explaining an example of 
embedding two pieces of additional information having 
different significance degrees on vertically separated 
embedding parts every one-frame screen FL. In the 
second embodiment, as shown in Fig. 9, a one-frame 
screen (each frame) of a video signal is divided into two 
in the vertical direction such that the information about, 
copy control having a higher significance degree is 
embedded in the upper two-third part (first embedding 
part) AR1 of the screen, and the additional data having 
less significant than the information about copy control 
is embedded in the lower one-third part (second 
embedding part) AR2 of the screen, depending on the 
significance degrees of the additional information. 
[0131] Stated another way. the second embodiment 
is similar to the first embodiment in that the area of the 
embedding part in which the more significant additional 
information is embedded as electronic watermark infor- 
mation is set larger than the embedding part in which 
the less significant additional information is embedded 
as electronic watermark information. Also, in this exam- 
ple, the embedding part AR1 for the more significant 
information about copy control is set twice larger than 
the embedding part AR2 for the less significant addi- 
tional data. 

[0132] Fig. 10 is a diagram explaining timing signals 
generated in the timing controller 4 in the case where 
the embedding parts for embedding different additional 
information as electronic watermark information are 
separated in the vertical direction on the one-frame 
screen FL of a video signal, as shown in Fig. 9. 
[0133] Also, in the second embodiment, the infor- 
mation about copy control as the more significant first 
additional information and the additional data less sig- 
nificant than the first additional information are embed- 
ded such that their cycles are completely fit into one 
screen of the video signal, as is the case of the afore- 
mentioned first embodiment. 

[0134] For this reason, the reset signal RE is a sig- 
nal having a period equal to one frame, similar to the 
reset signal RE in the first embodiment, as illustrated in 
Fig. 10A, and the clock signal PNCLK is a signal, for 
example, for providing a timing corresponding to each 
pixel of the video signal, as illustrated in Fig. 10C. 
[0135] Then, in the second embodiment, the first 
enable signal EN1 is formed on the basis of the vertical 
synchronization signal V and the horizontal synchroni- 
zation signal H, and is a signal having a period equal to 
one frame which falls at a leading edge of the vertical 
synchronizing signal, is at a low level during the former 
two-third interval of one frame period, and is at a high 
level during the subsequent one-third interval, as illus- 
trated in Fig. 10D. 

[0136] In other words, the first enable signal EN1 is 
a signal formed in each frame such that it is at a low 
level in a part corresponding to the first embedding part 
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AR1 shown in Fig. 9. and at a high level in a part corre- 
sponding to the second embedding part AR2. 
[0137] The second enable signal EN2 is also 
formed on the basis of the vertical synchronization sig- 
nal V and the horizontal synchronization signal H, and is 
a signal having a period equal to one frame which rises 
at a leading edge of the vertical synchronization signal, 
is at a high level during the former two-third interval of 
one frame period, and is at a low level during the subse- 
quent one-third interval, as illustrated in Fig. 10E. 
[0138] In other words, the second enable signal 
EN2. reverse to the first enable signal EN1. is a signal 
formed in each frame such that it is at a high level in a 
part corresponding to the first embedding part AR1 
shown in Fig. 9. and at a low level in a part correspond- 
ing to the second embedding part AR2. 
[0139] For generating the first enable signal EN1 
and the second enable signal EN2, the intervals during 
which the signals are at a low levels and the intervals at 
which the signals are at a high levels can be set by 
counting the horizontal synchronization signal H. Also, 
in the second embodiment, the first enable signal EN1 
and the second enable signal EN2 are both low active. 
[0140] The combination timing signal. SW is formed 
on the basis of the vertical synchronization signal V and 
the horizontal synchronization signal H as a signal hav- 
ing a period equal to one frame which falls at the leading 
edge of the vertical synchronization signal, is at a low 
level during the former two-third interval of one frame 
period and is at a high level during the subsequent one- 
third interval, just like the first enable signal EN1 . 
[0141] Also, similarly to the aforementioned first 
embodiment, the first PN generator 5 generates a first 
PN code sequence PS1 using the reset signal RE, the 
first enable signal EN1 and the clock signal PNCLK. 
while the second PN generator 7 generates a second 
PN code sequence PS2 using the reset signal RE, the 
second enable signal EN2 and the clock signal PNCLK. 
[0142] The first additional information generator 6 
generates an information sequence FS1 concerning 
copy control at the timing of the first enable signal EN1 
based on the clock signal PNCLK, while the second 
additional information generator 8 generates an addi- 
tional data sequence FS2 at the timing of the second 
enable signal EN2 based on the clock signal PNCLK. 
[0143] Then, the spreader 9 performs the spread 
spectrum on the information sequence FS1 concerning 
the copy control with the first PN code sequence PS1 to 
form electronic watermark information (spread spec- 
trum signal) SS1 which is then supplied to the weighting 
combiner 11. Similarly, the spreader 10 performs the 
spread spectrum on the additional data sequence FS 
with the second PN code sequence PS2 to form elec- 
tronic watermark information (spread spectrum signal) 
SS2 which is then supplied to the weighting combiner 
11. 

[0144] The weighting combiner 11, based on the 
combination timing signal SW. outputs the electronic 



watermark information SS1 indicating the information 
about copy control while the combination timing signal 
SW is at a low level, and outputs the electronic water- 
mark information SS2 indicating the additional data 

5 while the combination timing signal SW is at a high 
level, thereby outputting a combination of the electronic 
watermark information SS1 indicating the information 
about copy control and the electronic watermark infor- 
mation SS2 indicating the additional data accommo- 

10 dated in the separate embedding parts allocated 
thereto. 

[0145] The combination output from the weighting 
combiner 11 is embedded on a video signal which has 
been converted to a digital signal in the A/D converter 2. 

15 by the WM embedding section 13. In this case, as 
shown in Fig. 9. the electronic watermark information 
SS1 indicating the information about copy control is 
embedded in the first embedding part AR1 which occu- 
pies the upper two-third part of a screen, while the elec- 

20 tronic watermark information SS2 indicating the 
additional data is embedded in the second embedding 
part AR2 which occupies the lower one-third part of a 
screen. In this event, the electronic watermark informa- 
tion SS1 and the electronic watermark information SS2 

25 are both embedded on the video signal at the same 
embedding level. 

[0146] Thus, as is the case of the authoring appara- 
tus of the first embodiment, the two pieces of additional 
information having different significance degrees are 

30 embedded on the video signal as the electronic water- 
mark information at the same embedding level, so that 
the embedding of the electronic watermark information 
on the video signal will not deteriorate an image repro- 
duced from the video signal. 

35 [0147] Also, in the authoring apparatus of the sec- 
ond embodiment, the embedding part AR1 for embed- 
ding the information about copy control as electronic 
watermark information is defined to be larger than the 
embedding part AR2 for embedding the additional data 

40 as electronic watermark information, as is the case of 
the authoring apparatus of the first embodiment. 
[0148] For this reason, even though the two pieces 
of additional information are embedded in the same 
screen, the more significant additional information, 

45 which is embedded in the larger area of the video sig- 
nal, can be more reliably and rapidly detected than the 
less significant additional information. 
[0149] Further, with respect to the less significant 
additional information, which is allocated a smaller 

50 embedding area than the more significant additional 
information, the embedding part is previously set, so 
that the less significant additional information can also 
be reliably detected, although a slightly longer detection 
time is required therefor. 

55 [0150] In this way. the authoring apparatus of the 
second embodiment can also embed two pieces of 
additional information having different significance 
degrees on a video signal, in which a reproduced image 
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is not deteriorated and the more significant additional 
information can be reliably and rapidly detected. 
[0151] As described above, even when additional 
information having different significance degrees are 
embedded in vertically separated embedding parts on a 5 
one-frame screen of a video signal as electronic water- 
mark information, the additional information embedded 
on the video signal can be detected by generating the 
same PN code sequences as those used for performing 
the spread spectrum on the electronic watermark infor- w 
mation. at the same timing for the video signal, and by 
de-spreading the electronic watermark information with 
the thus generated PN code sequences. 
[0152] Stated another way. a WM decoder for 
detecting electronic watermark information embedded is 
on a video signal can be configured in a manner similar 
to the WM decoder 26 previously described with refer- 
ence to Fig. 8. Then, in the second embodiment, the 
timing controller 263 in the WM decoder 26 generates 
the reset signal RE. the first enable signal EN1 , the sec- 20 
ond enable signal EN2 and the clock signal PNCLK. as 
illustrated in Fig. 10. 

[0153] Then, the first PN code sequence PN1 and 
the second PN code sequence PN2 are generated 
using the respective timing signals generated in the tim- 25 
ing controller 263. and used to despread the electronic 
watermark information, thereby making it possible to 
detect the additional information embedded as the elec- 
tronic watermark information on the respective vertically 
separated embedding parts in each screen of the video 30 
signal. Thus, the recording/reproducing apparatus of 
the first embodiment previously described with refer- 
ence to Figs. 7 and 8 can be used in the second embod- 
iment by changing the timing signals generated" in the 
timing controller 263 of the WM decoder 26. 35 

[Third Embodiment] 

[01 54] In a third embodiment, more significant infor- 
mation about copy control and additional data less sig- 40 
nificant than the information about copy control are 
embedded in separate frames as electronic watermark 
information such that they are completely accommo- 
dated in each frame, where the number of frames allo- 
cated as a embedding part is varied depending on the 45 
significance degrees of additional information. 
[0155] Specifically, the electronic watermark infor- 
mation indicating the more significant information about 
copy control or the electronic watermark information 
indicating the additional data less significant than the so 
information about copy control is embedded every 
frame of a video signal, in which case, the number of 
frames in which the electronic watermark information 
indicating the more significant information about copy 
control is set more than the number of frames in which 55 
the electronic watermark information indicating the 
additional data is embedded. 

[0156] Also, in this case, an authoring apparatus for 



recording a video signal on which additional information 
having different significance degrees are embedded as 
electronic watermark information, on a recording 
medium, for example, a DVD or the like, can be config- 
ured in a manner similar to the authoring apparatus 
illustrated in Fig. 1, as is the case of the aforementioned 
first and second embodiments. For this reason, the 
authoring apparatus of the third embodiment will be 
explained assuming that it is configured in a manner 
similar to the authoring apparatus illustrated in Fig. 1. 
with reference also to Fig. 1. 

[0157] However, as will be explained below, the 
third embodiment differs from the first embodiment in 
timing signals generated in the timing controller 4. 
[0158] Fig. 1 1 is a diagram explaining an example 
of embedding two pieces of additional information hav- 
ing different significance degrees on different frames. In 
Fig. 1 1 . a frame AF indicates a frame in which the infor- 
mation about copy control is embedded as electronic 
watermark information, and a frame BF indicates a 
frame in which the additional data is embedded as elec- 
tronic watermark information. 

[0159] Specifically, in the third embodiment, the 
information about copy control is embedded in consec- 
utive two of every three frames, while the electronic 
watermark information indicating the additional data is 
embedded in the remaining one of the same three 
frames, as illustrated in Fig. 1 1 . 

[0160] Fig. 12 is a diagram explaining the timing 
signals generated in the timing controller 4 in the 
authoring apparatus in the case where the electronic 
watermark information indicating the information about 
copy control is embedded in consecutive two of every 
three frames, and the electronic watermark information 
indicating the additional data is embedded in the 
remaining one of the same three frames, as illustrated 
in Fig. 1 1 . 

[0161] In the third embodiment, the information 
about copy control as more significant first additional 
information and the additional data less significant than 
the first additional information are embedded such that 
each of them is accommodated completely in each 
frame of the video signal. 

[0162] For this purpose, as illustrated in Fig. 12A. a 
reset signal RE is a signal having a period equal to one 
frame, similar to the reset signals RE of the first and 
second embodiments. Also, the clock signal PNCLK is a 
signal, for example, for providing the timing correspond- 
ing to each pixel of the video signal, as illustrated in Fig. 
12C. 

[0163] Then, in the third embodiment, the first ena- 
ble signal EN1 is formed on the basis of the vertical syn- 
chronization signal V. and is a signal having a period 
equal to three frames which falls at a leading edge of 
the vertical synchronization signal, is at a low level in the 
subsequent two frames, and is at a high level in the next 
one frame, as illustrated in Fig. 12D. 
[0164] In other words, the first enable signal EN1 is 
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a signal formed such that it is at a low level in parts cor- 
responding to the frames AF illustrated in Fig. 11. and at 
a high level in parts corresponding to the frames BF. 
[0165] The second enable signal EN2 is also 
formed on the basis of the vertical synchronization sig- 5 
nal V. and is a signal having a period equal to three 
frames which rises at the leading edge of the vertical 
synchronization signal, is at a high level in the two 
frames, and is at a low level in the next one frame, as 
illustrated in Fig. 12E. w 
[0166] In other words, the second enable signal, 
reverse to the first enable signal EN1, is at a high level 
in the parts corresponding to the frames AF illustrated in 
Fig. 11. and at a low level in the parts corresponding to 
the frames BF is 
[0167] For generating the first enable signal EN1 
and the second enable signal EN2, the intervals during 
which the signals are at low levels and the intervals in 
which the signals are at high levels can be set by count- 
ing the vertical synchronization signal V. Also, in the 20 
third embodiment, the first enable signal EN1 and the 
second enable signal EN2 are both low active. 
[0168] A combination timing signal SW is formed on 
the basis of the vertical synchronization signal V as a 
signal having a period equal to three frames, which falls 25 
at the leading edge of the vertical synchronization sig- 
nal, is at a low level in the subsequent two frames, and 
is at a high level in the next one frame, just like the first 
enable signal EN1. as illustrated in Fig. 12F 
[0169] Then, as is the case of the aforementioned 30 
first and second embodiments, the PN code sequence 
PS1 generated in the first PN generator 5 using the 
reset signal RE. the first enable signal EN1 and the 
clock signal PNCLK, is supplied to the despreader 9. 
while the second PN code sequence PS2 generated in 35 
the second PN. generator 7 using the reset signal RE. 
the second enable signal EN2 and the clock signal 
PNCLK is supplied to the despreader 10. 
[0170] Also, an information sequence FS1 concern- 
ing the copy control, generated in the first additional 40 
information generator 6 at the timing of the first enable 
signal EN1 based on the clock signal PNCLK, is sup- 
plied to the spreader 9, while an additional data 
sequence FS2 generated in the second additional infor- 
mation generator 8 at the timing of the second enable 45 
signal EN2 based on the clock signal- PNCLK is sup- 
plied to the spreader 10. 

[0171] Then, as has been also described above, 
the spreader 9 and the spreader 10 perform the spread 
spectrum. Consequently, electronic watermark informa- 50 
tion SS1 indicating the information about copy control is 
supplied from the spreader 9 to the weighting combiner 
11. while electronic watermark information SS2 indicat- 
ing the additional data is supplied from the spreader 10 
to the weighting combiner 11. 55 
[0172] The weighting combiner 11. based on the 
combination timing signal SW, outputs the electronic 
watermark information SS1 indicating the information 



about copy control while the combination timing signal 
SW is at a low level, and outputs the electronic water- 
mark information SS2 indicating the additional data 
while the combination timing signal SW is at a high 
level. 

[0173] The combination output from the weighting 
combiner 11 is embedded on a video signal, which has 
been converted to a digital signal in the A/D converter 2. 
by the WM embedding section 13. In this case, as illus- 
trated in Fig. 11 and also in Fig. 12G. the electronic 
watermark information SS1 indicating the information 
about copy control is embedded in consecutive two 
frames of every three frames such that it is completely 
accommodated in each frame, and the electronic water- 
mark information SS2 indicating the additional data is 
embedded in the remaining one of the every three 
frames. Also, in this case, the electronic watermark 
information SS1 and the electronic watermark informa- 
tion SS2 are both embedded on the video signal at the 
same embedding level. 

[0174] Thus, as is the case of the authoring appara- 
tus of the first and second embodiments, the two pieces 
of additional information having different significance 
degrees are embedded on the video signal as the elec- 
tronic watermark information at the same embedding 
level, so that the embedding of the electronic watermark 
information on the video signal will not deteriorate in an 
image reproduced from the video signal. 
[0175] Also, in the authoring apparatus of the third 
embodiment, the embedding part for the information 
about copy control as electronic watermark information 
is larger than the embedding part for the additional data 
as electronic watermark information, as is the case of 
the authoring apparatus of the first and second embod- 
iments. 

[0176] For this reason, the more significant addi- 
tional information, which is embedded in the larger area 
of the video signal, can be more reliably and rapidly 
detected than the less significant additional information. 
[0177] Further, with respect to the less significant 
additional information, which is allocated a smaller 
embedding area than the more significant additional 
information, the embedding part is previously set. so 
that the less significant additional information can also 
be reliably detected, although a slightly longer detection 
time is required therefor. 

[0178] In this way. the authoring apparatus of the 
third embodiment can also embed two pieces of addi- 
tional information having different significance degrees 
on a video signal in such a manner that a reproduced 
image will not be degraded and the more significant 
additional information can be reliably and rapidly 
detected. 

[0179] As described above, even when additional 
information having different significance degrees are 
embedded on a video signal as electronic watermark 
information, as is the case of the third embodiment, the 
additional information embedded on the video signal 
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can be detected by generating the same PN code 
sequences as those used for performing the spread 
spectrum on the electronic watermark information 
embedded on the video signal, at the same timing for 
the video signal, and de-spreading the electronic water- 
mark information with the thus generated PN code 
sequences. 

[0180] Stated another way. a WM decoder for 
detecting the electronic watermark information embed- 
ded on a video signal can be configured in a manner 
similar to the WM decoder 26 previously described with 
reference to Fig. 8. Then, in the third embodiment, the 
timing controller 263 in the WM decoder 26 generates 
the reset signal RE, the first enable signal EN1 . the sec- 
ond enable signal EN2. the clock signal PNCLK and the 
combination timing signal SW. as illustrated in Figs. 12A 
to12G. 

[0181] Then, the first PN code sequence PN1 and 
the second PN code sequence PN2 are generated 
using the timing signals generated in the timing control- 
ler 263. and used to de-spread the electronic watermark 
information, thereby making it possible to detect the 
additional information embedded as the electronic 
watermark information on the respective vertically sep- 
arated embedding parts in each screen of the video sig- 
nal. Thus, the recording/reproducing apparatus of the 
first embodiment previously described with reference to 
Figs. 7 and 8 can be used in the third embodiment by 
changing the timing signals generated in the timing con- 
troller 263 of the WM decoder 26. 

[01 82] Note that, in the foregoing embodiments, the 
information about copy control and the additional data 
are embedded as electronic watermark information 
within a one-frame screen of a video signal, i.e.. on an 
image of one frame. However, the present invention is 
not limited to this case. Alternatively, the information 
about copy control and the additional data as electronic 
watermark information can of course be separately 
embedded in the different embedding parts of a one- 
field screen of a video signal, i.e., of one field of image. 
[0183] Stated another way, the additional informa- 
tion to be embedded on a video signal can of course be 
separately embedded in embedding parts on a frame 
basis or be separately embedded in embedding parts 
on a field basis. 

[0184] Further, in the foregoing embodiments, two 
pieces of additional information having different signifi- 
cance degrees (the information about copy control and 
the additional data) are embedded on a video signal as 
electronic watermark information. However, the number 
of additional information having different significance 
degrees is not limited to two. Any plural pieces of infor- 
mation having different significance degrees can be 
embedded on a video signal. In addition, the data length 
of each additional information is not limited to four bits 
but can be one bit or more. 

[0185] For example, in the case where three or four 
pieces of additional information having different signifi- 



cance degrees are embedded on a video signal as elec- 
tronic watermark information, embedding parts for 
embedding the respective additional information as 
electronic watermark information can be defined 
5 depending on the significance degrees of the additional 
information. 

[0186] Also, for example, in the case where three 
additional information having different significance 
degrees are embedded on a video signal, with one of 

w them has a higher significance degree and the remain- 
ing two having similarly a low significance degree, it will 
be taken as granted that a larger embedding part can be 
allotted to the more significant additional information as 
electronic watermark information, while similar embed- 

15 ding parts can be allotted to the remaining two pieces of 
additional information. 

[0187] >• Further, in the case where two pieces of 
additional information having different significance 
degrees are embedded within one screen, embedding 

20 parts can be subdivided, for example, in such a manner 
that the first ten horizontal lines are is allocated for 
embedding electronic watermark information indicating 
the more significant additional information, the next five 
horizontal lines are allocated for embedding electronic 

25 watermark information indicating the less significant 
additional information, the next ten horizontal lines are 
allocated for embedding electronic watermark informa- 
tion indicating the more significant additional informa- 
tion. 

30 [0188] In essence, the embedding part for embed- 
ding the electronic watermark information indicating the 
more significant additional information is only required 
to be larger than the embedding part for embedding the 
electronic watermark information indicating the less sig- 
35 nificant additional information. 

[0189] Further, in the foregoing embodiments, the 
embedding parts are previously defined for the two 
pieces of additional information. However, a user can 
specify the sizes of the embedding parts for the addi- 
40 tional information, for example, through the key manipu- 
lation unit. Then, the controller can supply the timing 
controller with a control signal for generating timing sig- 
nals in accordance with the instructions from the user, 
thereby making it possible to embed the additional infor- 
ms mation as electronic watermark information on embed- 
ding parts having the sizes specified by the user. 
[0190] Further, in the foregoing embodiments, the 
electronic watermark information is formed by perform- 
ing the spread spectrum on additional information using 
50 a PN code sequence. The spread codes used for the 
spread spectrum are not limited to the PN codes, but a 
variety of spread codes may be used instead. 
[0191] Furthermore, in the foregoing embodiments, 
the electronic watermark information is embedded on a 
55 video signal before the data compression. However, the 
electronic watermark information can of course be 
embedded on a video signal which has been subjected 
to the data compression. 
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[0192] Also, the electronic watermark information is 
not limited to those formed by the spread spectrum, but 
can be formed using a variety of electronic watermark 
techniques. For example, predefined electronic water- 
mark information, referred to as "unit electronic water- 5 
mark information" (unit watermark) can be previously 
prepared for each additional information to be embed- 
ded on a video signal, and can be embedded on a video 
signal. 

[0193] When this unit electronic watermark infor- 10 
mation is used, a plurality of unit electronic watermark 
information are simultaneously generated correspond- 
ing to plural pieces of additional information, such that 
the unit electronic watermark information to be embed- 
ded can be switched for each of predefined embedding 15 
parts in accordance with the significance degrees of the 
additional information. This embedding scheme can be 
supported such that the respective unit electronic water- 
mark information corresponding to the additional infor- 
mation can be switched, for example, in the 20 
aforementioned weighting combiner 1 1 at the timing of 
the combination timing signal SW from the timing con- 
troller 4. 

[0194] Further, even when electronic watermark 
information indicating additional information having dif- 25 
ferent significance degrees are formed, for example, by 
the spread spectrum, electronic watermark information 
can be generated and held in accordance with embed- 
ding parts defined depending on the significance 
degrees of the additional information, and for example, 30 
the weighing combiner can combine them at the timing 
of the combination timing signal in such a manner that 
they are separately embedded in respective embedding 
parts. 

[0195] Further, in the foregoing embodiments, the 35 
additional information embedding method and addi- 
tional information embedding apparatus according to 
the present invention are applied to an authoring appa- 
ratus for a DVD. and the additional information detecting 
method and additional information detecting apparatus JO 
are applied to a recording/reproducing apparatus. How- 
ever, the present invention is not limited to such particu- 
lar applications. 

[0196] The additional information embedding 
method and additional information embedding appara- 45 
tus according to the present invention can be applied to 
a broadcasting related devices for use in a broadcasting 
station for broadcasting video signals; information 
processing apparatus such as personal computers 
capable of transmitting and receiving information sig- 50 
nals such as video signals; or a variety of output devices 
for outputting video signals such as a video signal 
reproducing apparatus having a function of embedding 
electronic watermark information. 

[0197] The additional information detecting method 55 
and additional information detecting apparatus accord- 
ing to the present invention can be applied to receivers, 
referred to as a set top box or a cable box, for receiving 



broadcast signals from broadcasting stations; a variety 
of recording apparatus and recording/reproducing 
apparatus; or information processing apparatus such as 
personal computers capable of transmitting and receiv- 
ing video signals, i.e.. a variety of apparatus which 
receives video signals provided thereto and processes 
the provided video signals. 

[0198] Also, the foregoing embodiments have been 
explained for an example in which electronic watermark 
information are embedded on a video signal. However, 
the present invention can also be applied when elec- 
tronic watermark information are embedded on an 
audio signal, computer data, and so on. 
[0199] As explained above, according to the addi- 
tional information embedding method of this invention, 
when additional information are embedded on a video 
signal as electronic watermark information, they can be 
embedded on the video signal so as to more readily 
detect an additional information having a higher signifi- 
cance degree. 

[0200] Also, according to the additional information 
embedding method of this, plural pieces of additional 
information having different significance degrees can be 
embedded as electronic watermark information within a 
one-frame or one-field screen of a video signal so as to 
more readily detect additional information having a 
higher significance degree. 

[0201] Further, according to the additional informa- 
tion embedding method of this invention, since a 
embedding part allocated to additional information hav- 
ing a higher significance degree is provided with a 
larger number of frames or a larger number of fields, 
which comprise the embedding part, plural pieces of 
additional information having different significance 
degrees can be embedded on a video signal as elec- 
tronic watermark information so as to more readily 
detect additional information having a higher signifi- 
cance degree. 

[0202] Further, according to the additional informa- 
tion embedding method of this invention, plural pieces 
of additional information having different significance 
degrees can be embedded as electronic watermark 
information on a video signal at a uniform embedding 
level without the need for varying the embedding levels 
for the additional information as electronic watermark 
information in accordance with their significance 
degrees, in order to more readily detect electronic 
watermark information indicating additional information 
having a higher significance degree than electronic 
watermark information indicating additional information 
having a lower significance degree. In this way. since no 
difference in level will be produced among their embed- 
ding parts in which the respective additional information 
are embedded as electronic watermark information, the 
embedding of the additional information as electronic 
watermark information on the video signal will not dete- 
riorate a reproduced image from the video signal. 
[0203] Further, according to the additional informa- 
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lion embedding apparatus and method, it is possible to 
reliably detect each of plural pieces of additional infor- 
mation having different significance degrees embedded 
on a video signal as electronic watermark information, 
wherein additional information having a higher signifi- 5 
cance degree can be more reliably and rapidly 
detected. 

[0204] Further, since a embedding part for embed- 
ding electronic watermark information indicating addi- 
tional information having a higher significance degree is 10 
set to have a larger area within a one-frame or one-field 
screen, the additional information having a higher signif- 
icance degree can be more reliably and rapidly 
detected. In addition, it is possible to reliably detect 
each of plural pieces of additional information having is 
different significance degrees which are embedded in a 
one-frame or one-field screen of a video signal as elec- 
tronic watermark information. 

[0205] Further, since a embedding part in which 
additional information having a higher significance 20 
degree is embedded as electronic watermark informa- 
tion is set to have a larger number of frames or a larger 
number of fields which comprise the embedding part, 
the additional information having a higher significance 
degree can be more reliably and rapidly detected. In 25 
addition, it is possible to reliably detect each of plural 
pieces of additional information having different signifi- 
cance degrees which are embedded as electronic 
watermark information. 

[0206] While there has been described in connec- 30 
tion with the preferred embodiments of the invention, it 
will be obvious to those skilled in the art that various 
changes and modifications may be aimed, therefore, to 
cover in the appended claims all such changes and 
modifications as fall within the scope of the invention. 35 

Claims 

1. An additional information embedding apparatus for 

embedding plural pieces of additional information <*o 
having different significance degrees on a signal, 
comprising: 

means for generating said plural pieces of addi- 
tional information; J5 
electronic watermark information generating 
means for converting said plural pieces of addi- 
tional information into electronic watermark 
information; 

control means for controlling the size of a 50 
embedding part for each of said electronic 
watermark information in accordance with the 
significance degree of the corresponding addi- 
tional information; and 

embedding means for embedding said elec- 55 
tronic watermark information on said signal 
based on a control signal from said control 
means. 



2. The additional information embedding apparatus 
according to claim 1. wherein: 

said signal is a video signal; and 
said control means controls said embedding 
means so that each of said electronic water- 
mark information is embedded within a one- 
frame screen or a one-field screen of said 
video signal, and that a embedding part for 
electronic watermark information indicating 
additional information having a higher signifi- 
cance degree is set to be larger in size. 

3. The additional information embedding apparatus 
according to claim 1. wherein: 

said signal is a video signal; and 
said control means controls said embedding 
means so that each of said electronic water- 
mark information is embedded on a one- or plu- 
ral-frame basis of said video signal or on one- 
or plural-filed basis of said video signal, 
wherein a embedding part for electronic water- 
mark information indicating additional informa- 
tion having a higher significance degree is set 
to occupy a larger number of frames or a larger 
number of fields which constitute said embed- 
ding part. 

4. The additional information embedding apparatus 
a according to claim 1. wherein 

said embedding means embeds said plural 
pieces of electronic watermark information 
having different significance degrees are 
embedded on said video signal at embedding 
levels equal to one another. 

5. An additional information embedding apparatus 
comprising: 

a plurality of additional information generating 
means for generating additional information 
having different significance degrees; 
a plurality of electronic watermark information 
generating means provided correspondingly to 
said plurality of additional information generat- 
ing means for generating plural pieces of elec- 
tronic watermark information from said 
additional information obtained by said addi- 
tional information generating means; 
combining means for combining said plural 
pieces of electronic watermark information 
obtained by said plurality of electronic water- 
mark information generating means while they 
are assigned to separate embedding parts; 
combination timing signal generating means 
for producing a combination timing signal used 
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for controlling a combination timing of said 
combining means so that the size of the 
embedding part for each of said plural pieces of 
additional information having different signifi- 
cance degrees is set in accordance with the 5 
significance degree of the corresponding addi- 
tional information; and 

embedding means for embedding the com- 
bined electronic watermark information 
obtained by said combining means, on said w 
video signal. 



6. The additional information embedding apparatus 
according to claim 5. wherein 

15 

said combination timing signal generating 
means generates said combination timing sig- 
nal so that said plural pieces of the electronic 
watermark information from said plurality of 
electronic watermark information generating 20 
means are embedded within a one-frame or 
one-field screen of said video signal, and that a 
embedding part for electronic watermark infor- 
mation indicating additional information having 
a higher significance degree is set to be larger 25 
in size. 

7. The additional information embedding apparatus 
according to claim 5, wherein 

30 

said combination timing signal generating 
means generates said combination timing sig- 
nal so that said plural pieces of electronic 
watermark information obtained by said plural- 
ity of electronic watermark information generat- 35 
ing means are embedded with one or plural 
frame(s) of said video signal or on one or plural 
field(s) of said video signal as a embedding 
part unit, and that a embedding part for elec- 
tronic watermark information indicating addi- 40 
tional information having a higher significance 
degree is set to occupy a larger number of 
frames or a larger number of fields which con- 
stitute said embedding part. 

45 

8. The additional information embedding apparatus 
according to claim 5, wherein 

said plural pieces of electronic watermark infor- 
mation respectively indicating said plural 50 
pieces of additional information having different 
significance degrees are embedded on said 
video signal at embedding levels equal to one 
another. 

55 

9. An additional information detecting apparatus for 
detecting plural pieces of additional information 
from a video signal on which said plural pieces of 



additional information are embedded as electronic 
watermark information, wherein: 

said plural pieces of electronic watermark infor- 
mation respectively indicating said plural 
pieces of additional information are separately 
embedded in embedding parts, and the size of 
each embedding part is set in accordance to 
the significance degree of the corresponding 
additional information: and 
said additional information detecting apparatus 
comprises: 

detecting means for detecting additional infor- 
mation as electronic watermark information 
from said each embedding part which is set in 
accordance with the significance degree of 
said corresponding additional information: and 
detection timing signal generating means for 
producing a detection timing signal used for 
detecting additional information and supplying 
it to said detecting means, for said each 
embedding part which is set in accordance with 
the significance degree of said corresponding 
additional information. 

10. The additional information detecting apparatus 
according to claim 9, wherein 

in the case where said signal is a video signal, 
said plural pieces of electronic watermark infor- 
mation respectively indicating said plural 
pieces of additional information having different 
significance degrees are embedded within a 
one-frame or one-field screen of said video sig- 
nal, and the embedding parts for said plural 
pieces of electronic watermark information 
respectively indicating said plural pieces of 
additional information are set in such a manner 
that a embedding part for electronic watermark 
information indicating additional information 
having a higher significance degree is set to be 
larger in size in said one-frame or one-field 
screen. 

11. The additional information detecting apparatus 
according to claim 9. wherein 

in the case where said signal is a video signal, 
said plural pieces of electronic watermark infor- 
mation respectively indicating said plural 
pieces of additional information having different 
significance degrees are embedded on a one- 
or plural-frame basis of said video signal or on 
a one- or plural-field basis of said video signal, 
and a embedding part for electronic watermark 
information indicating additional information 
having a higher significance degree is set to 
occupy a larger number of frames or a larger 
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number of fields which constitute said embed- 
ding part. 

12. An additional information embedding method of 
embedding plural pieces of additional information 5 
having different significance degrees on a video 
signal, comprising: 



13. The additional information embedding method 25 
according to claim 12. wherein: 

said signal is a video signal; and 
said control step controls said embedding step 
so that each of said plural pieces of electronic 30 
watermark information is embedded within a 
one-frame or one-field screen of said video sig- 
nal and that a embedding part for electronic 
watermark information indicating additional 
information having a higher significance 35 
degree is set to be larger in size. 

14. The additional information embedding method 
according to claim 12. wherein: 

40 

said signal is a video signal; and 
said control step controls said embedding step 
so that each of said plural pieces of electronic 
watermark information is embedded on a one- 
or plural-frame basis or a one- or plural-field 45 
basis of said video signal, and that a embed- 
ding part for electronic watermark information 
indicating additional information having a 
higher significance degree is set to occupy a 
larger number of frames or a larger number of 50 
fields which constitute said embedding part. 

15. The additional information embedding method 
according to claim 12. wherein 

55 

said embedding step embeds said plural 
pieces of electronic watermark information 
having different significance degrees on said 



video signal at embedding levels equal to one 
another. 

1 6. A additional information detecting method of detect- 
ing plural pieces of additional information from a 
video signal on which said plural pieces of addi- 
tional information are embedded as electronic 
watermark information, wherein: 

said plural pieces of electronic watermark infor- 
mation respectively indicating said plural 
pieces of additional information are separately 
embedded in respective embedding parts, and 
the size of each embedding part is set in 
accordance with the significance degree of the 
corresponding additional information; and 
said additional information detecting method 
comprises: 

a detecting step of detecting additional 
information indicated by electronic water- 
mark information, from said each embed- 
ding part which is set in accordance with 
the significance degree of said corre- 
sponding additional information; and 
a detection timing signal generating step of 
generating a detection timing signal for 
detecting said additional information and 
supplying it to said detecting step, for said 
each embedding part which is set in 
accordance with the significance degree of 
said corresponding additional information. 

17. The additional information detecting method 
according to claim 16. wherein 

in the case where said signal is a video signal, 
each of said plural pieces of electronic water- 
mark information respectively indicating said 
plural pieces of additional information having 
different significance degrees is embedded 
within a one-frame or one-field screen of said 
video signal, and embedding parts for said plu- 
ral pieces of electronic watermark information 
respectively indicating said plural pieces of 
additional information are set in such a manner 
that a embedding part for electronic watermark 
information indicating additional information 
having a higher significance degree is set to be 
larger in size in said one-frame or one-field 
screen. 

18. The additional information detecting method 
according to claim 16, wherein 

in the case where said signal is a video signal, 
each of said plural pieces of the electronic 
watermark information indicating said plural 



a step of generating said plural pieces of addi- 
tional information; 10 
an electronic watermark information generating 
step of converting said plural pieces of addi- 
tional information into electronic watermark 
information: 

a control step of controlling the size of a 15 
embedding part for each of said plural pieces of 
electronic watermark information in accord- 
ance with the significance degree of the corre- 
sponding additional information; and 
a embedding step of embedding said plural 20 
pieces of electronic watermark information on 
said signal based on a control signal from said 
control step. 
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pieces of additional information having different 
significance degrees is embedded with one or 
plural frame(s) or one or plural field(s) of said 
video signal as a embedding part unit, and a 
embedding part for embedding electronic 5 
watermark information indicating additional 
information having a higher significance 
degree is set to occupy a larger number of 
frames or a larger number of fields which con- 
stitute said embedding part. w 
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